Prediction error for free monetary reward in the human prefrontal cortex.

نویسندگان

  • N Ramnani
  • R Elliott
  • B S Athwal
  • R E Passingham
چکیده

Making predictions about future rewards is an important ability for primates, and its neurophysiological mechanisms have been studied extensively. One important approach is to identify neural systems that process errors related to reward prediction (i.e., areas that register the occurrence of unpredicted rewards and the failure of expected rewards). In monkeys that have learned to predict appetitive rewards during reward-directed behaviors, dopamine neurons reliably signal both types of prediction error. The mechanisms in the human brain involved in processing prediction error for monetary rewards are not well understood. Furthermore, nothing is known of how such systems operate when rewards are not contingent on behavior. We used event-related fMRI to localize responses to both classes of prediction error. Subjects were able to predict a monetary reward or a nonreward on the basis of a prior visual cue. On occasional trials, cue-outcome contingencies were reversed (unpredicted rewards and failure of expected rewards). Subjects were not required to make decisions or actions. We compared each type of prediction error trial with its corresponding control trial in which the same prediction did not fail. Each type of prediction error evoked activity in a distinct frontotemporal circuit. Unexpected reward failure evoked activity in the temporal cortex and frontal pole (area 10). Unpredicted rewards evoked activity in the orbitofrontal cortex, the frontal pole, parahippocampal cortex, and cerebellum. Activity time-locked to prediction errors in frontotemporal circuits suggests that they are involved in encoding the associations between visual cues and monetary rewards in the human brain.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Neural coding of distinct statistical properties of reward information in humans.

Brain processing of reward information is essential for complex functions such as learning and motivation. Recent primate electrophysiological studies using concepts from information, economic and learning theories indicate that the midbrain may code two statistical parameters of reward information: a transient reward error prediction signal that varies linearly with reward probability and a su...

متن کامل

Splitting the difference: how does the brain code reward episodes?

Animal research and human brain imaging findings suggest that reward processing involves distinct anticipation and outcome phases. Error terms in popular models of reward learning (such as the temporal difference [TD] model) do not distinguish between the updating of expectations in response to reward cues and outcomes. Thus, correlating a single error term with neural activation assumes recrui...

متن کامل

Neural correlates of frustration.

Psychological considerations suggest that the omission of rewards in humans comprises two effects: first, an allocentric effect triggering learning and behavioural changes potentially processed by dopaminergic neurons according to the prediction error theory; second, an egocentric effect representing the individual's emotional reaction, commonly called frustration. We investigated this second e...

متن کامل

Functions of Learning Rate in Adaptive Reward Learning

As a crucial cognitive function, learning applies prediction error (the discrepancy between the prediction from learning and the world state) to adjust predictions of the future. How much prediction error affects this adjustment also depends on the learning rate. Our understanding to the learning rate is still limited, in terms of (1) how it is modulated by other factors, and (2) the specific m...

متن کامل

Social and monetary reward learning engage overlapping neural substrates.

Learning to make choices that yield rewarding outcomes requires the computation of three distinct signals: stimulus values that are used to guide choices at the time of decision making, experienced utility signals that are used to evaluate the outcomes of those decisions and prediction errors that are used to update the values assigned to stimuli during reward learning. Here we investigated whe...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • NeuroImage

دوره 23 3  شماره 

صفحات  -

تاریخ انتشار 2004